Subjective Annotation for a Frame Interpolation Benchmark using Artefact Amplification

Current benchmarks for optical flow algorithms evaluate the estimation either directly by comparing the predicted flow fields with the ground truth or indirectly by using the predicted flow fields for frame interpolation and then comparing the interpolated frames with the actual frames. In the latter case, objective quality measures such as the mean squared error are typically employed. However, it is well known that for image quality assessment, the actual quality experienced by the user cannot be fully deduced from such simple measures. Hence, we conducted a subjective quality assessment crowdscouring study for the interpolated frames provided by one of the optical flow benchmarks, the Middlebury benchmark. We collected forced-choice paired comparisons between interpolated images and corresponding ground truth. To increase the sensitivity of observers when judging minute difference in paired comparisons we introduced a new method to the field of full-reference quality assessment, called artefact amplification. From the crowdsourcing data, we reconstructed absolute quality scale values according to Thurstone's model. As a result, we obtained a re-ranking of the 155 participating algorithms w.r.t. the visual quality of the interpolated frames. This re-ranking not only shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks, the results also provide the ground truth for designing novel image quality assessment (IQA) methods dedicated to perceptual quality of interpolated images. As a first step, we proposed such a new full-reference method, called WAE-IQA. By weighing the local differences between an interpolated image and its ground truth WAE-IQA performed slightly better than the currently best FR-IQA approach from the literature.Comment: arXiv admin note: text overlap with arXiv:1901.0536

Subjective image quality assessment with boosted triplet comparisons.

In subjective full-reference image quality assessment, a reference image is distorted at increasing distortion levels. The differences between perceptual image qualities of the reference image and its distorted versions are evaluated, often using degradation category ratings (DCR). However, the DCR has been criticized since differences between rating categories on this ordinal scale might not be perceptually equidistant, and observers may have different understandings of the categories. Pair comparisons (PC) of distorted images, followed by Thurstonian reconstruction of scale values, overcomes these problems. In addition, PC is more sensitive than DCR, and it can provide scale values in fractional, just noticeable difference (JND) units that express a precise perceptional interpretation. Still, the comparison of images of nearly the same quality can be difficult. We introduce boosting techniques embedded in more general triplet comparisons (TC) that increase the sensitivity even more. Boosting amplifies the artefacts of distorted images, enlarges their visual representation by zooming, increases the visibility of the distortions by a flickering effect, or combines some of the above. Experimental results show the effectiveness of boosted TC for seven types of distortion (color diffusion, jitter, high sharpen, JPEG 2000 compression, lens blur, motion blur, multiplicative noise). For our study, we crowdsourced over 1.7 million responses to triplet questions. We give a detailed analysis of the data in terms of scale reconstructions, accuracy, detection rates, and sensitivity gain. Generally, boosting increases the discriminatory power and allows to reduce the number of subjective ratings without sacrificing the accuracy of the resulting relative image quality values. Our technique paves the way to fine-grained image quality datasets, allowing for more distortion levels, yet with high-quality subjective annotations. We also provide the details for Thurstonian scale reconstruction from TC and our annotated dataset, KonFiG-IQA , containing 10 source images, processed using 7 distortion types at 12 or even 30 levels, uniformly spaced over a span of 3 JND units

Crowdsourced quality assessment of enhanced underwater images: a pilot study.

Underwater image enhancement (UIE) is essential for a high-quality underwater optical imaging system. While a number of UIE algorithms have been proposed in recent years, there is little study on image quality assessment (IQA) of enhanced underwater images. In this paper, we conduct the first crowdsourced subjective IQA study on enhanced underwater images. We chose ten state-of-the-art UIE algorithms and applied them to yield enhanced images from an underwater image benchmark. Their latent quality scales were reconstructed from pair comparison. We demonstrate that the existing IQA metrics are not suitable for assessing the perceived quality of enhanced underwater images. In addition, the overall performance of 10 UIE algorithms on the benchmark is ranked by the newly proposed simulated pair comparison of the methods

Technical Report on Visual Quality Assessment for Frame Interpolation

Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.Comment: 11 pages, 6 figure

Effect of Lycii fructus polysaccharides on ovulation failure in rats

Purpose: To investigate the effect of Lycii Fructus polysaccharides (LFPS) on ovulation failure.Methods: A rat model of ovulation failure was established by intragastric administration of hydroxyurea (300 mg/kg). Rats with ovulation failure then received LFPS via oral administration at doses of 100, 200, or 400 mg/kg. The body, uterus and ovary of each rat were weighed using electronic scales. The hypothalamic-pituitary-ovarian (HPO) axis hormones, including estradiol (E2) level, follicle-stimulating hormone (FSH) activity, and luteinizing hormone (LH) activity in the serum of each rat were determined by enzyme-linked immunosorbent assay (ELISA). The levels of pro-apoptotic proteins (Fas, FasL, FADD, c-caspase-8, c-caspase-10, c-caspase-3, c-caspase-6, and c-caspase-7) in the ovarian tissue of each rat were detected by western blot.Results: Hydroxyurea reduced significantly (p < 0.01) uterus and ovary indices (uterus or ovary weight/body weight) (0.119 and 0.026 %), E2 level (3.42 pmol/L), and FSH and LH activities (2.28 and 2.76 U/L), compared with those in the normal group (0.169 and 0.039 %; 6.72 pmol/L; 2.76 and 3.75 U/L). Hydroxyurea increased significantly (p < 0.01) the levels of the above-mentioned pro-apoptotic proteins relative to those in the normal group. LFPS (100, 200, or 400 mg/kg) reversed significantly (p < 0.05 or 0.01) the effect of hydroxyurea on all of the above indices.Conclusion: LFPS exhibits a protective effect on hydroxyurea-induced ovulation failure by regulating the HPO axis hormones and death receptor-mediated apoptotic pathway.Keywords: Lycii Fructus polysaccharides, Ovulation failure, Hypothalamic-pituitary-ovarian axis, Death receptor-mediated apoptotic pathwa

Efficacy and Safety of Tribendimidine Against Clonorchis sinensis

In this randomized open-label trial, tribendimidine was shown to have an efficacy comparable to praziquantel for the treatment of Clonorchis sinensis infection. Patients treated with praziquantel experienced significantly more adverse events than tribendimidine recipient

Chemical characteristics of cloud water and the impacts on aerosol properties at a subtropical mountain site in Hong Kong SAR

To investigate the cloud water chemistry and the effects of cloud processing on aerosol properties, comprehensive field observations of cloud water, aerosols, and gasphase species were conducted at a mountaintop site in Hong Kong SAR in October and November 2016. The chemical composition of cloud water including water-soluble ions, dissolved organic matter (DOM), carbonyl compounds (refer to aldehydes and acetone), carboxylic acids, and trace metals was quantified. The measured cloud water was very acidic with a mean pH of 3.63, as the ammonium (174 μeq L-1) was insufficient for neutralizing the dominant sulfate (231 μeq L-1) and nitrate (160 μeq L-1). Substantial DOM (9.3 mgC L-1) was found in cloud water, with carbonyl compounds and carboxylic acids accounting for 18% and 6% in carbon molar concentrations, respectively. Different from previous observations, concentrations of methylglyoxal (19.1 μM; μM is equal to μmol L-1) and glyoxal (6.72 μM) were higher than that of formaldehyde (1.59 μM). The partitioning of carbonyls between cloud water and the gas phase was also investigated. The measured aqueous fractions of dicarbonyls were comparable to the theoretical estimations, while significant aqueous-phase supersaturation was found for less soluble monocarbonyls. Both organics and sulfate were significantly produced in cloud water, and the aqueous formation of organics was more enhanced by photochemistry and under less acidic conditions. Moreover, elevated sulfate and organics were measured in the cloudprocessed aerosols, and they were expected to contribute largely to the increase in droplet-mode aerosol mass fraction. This study demonstrates the significant role of clouds in altering the chemical compositions and physical properties of aerosols via scavenging and aqueous chemical processing, providing valuable information about gas-cloud-aerosol interactions in subtropical and coastal regions. © 2020 Author(s). This work is distributed under the Creative Commons Attribution 4.0 License

Deciphering the genetic basis for polyketide variation among mycobacteria producing mycolactones.

BACKGROUND: Mycolactones are immunosuppressive and cytotoxic polyketides, comprising five naturally occurring structural variants (named A/B, C, D, E and F), produced by different species of very closely related mycobacteria including the human pathogen, Mycobacterium ulcerans. In M. ulcerans strain Agy99, mycolactone A/B is produced by three highly homologous type I polyketide megasynthases (PKS), whose genes (mlsA1: 51 kb, mlsA2: 7.2 kb and mlsB: 42 kb) are found on a 174 kb plasmid, known as pMUM001. RESULTS: We report here comparative genomic analysis of pMUM001, the complete DNA sequence of a 190 kb megaplasmid (pMUM002) from Mycobacterium liflandii 128FXT and partial sequence of two additional pMUM replicons, combined with liquid chromatography-tandem mass spectrometric (LC-MS/MS) analysis. These data reveal how PKS module and domain differences affecting MlsB correlate with the production of mycolactones E and F. For mycolactone E these differences from MlsB in M. ulcerans Agy99 include replacement of the AT domain of the loading module (acetate to propionate) and the absence of an entire extension module. For mycolactone F there is also a reduction of one extension module but also a swap of ketoreductase domains that explains the characteristic stereochemistry of the two terminal side-chain hydroxyls, an arrangement unique to mycolactone F CONCLUSION: The mycolactone PKS locus on pMUM002 revealed the same large, three-gene structure and extraordinary pattern of near-identical PKS domain sequence repetition as observed in pMUM001 with greater than 98.5% nucleotide identity among domains of the same function. Intra- and inter-strain comparisons suggest that the extreme sequence homogeneity seen among the mls PKS genes is caused by frequent recombination-mediated domain replacement. This work has shed light on the evolution of mycolactone biosynthesis among an unusual group of mycobacteria and highlights the potential of the mls locus to become a toolbox for combinatorial PKS biochemistry.RIGHTS : This article is licensed under the BioMed Central licence at http://www.biomedcentral.com/about/license which is similar to the 'Creative Commons Attribution Licence'. In brief you may : copy, distribute, and display the work; make derivative works; or make commercial use of the work - under the following conditions: the original author must be given credit; for any reuse or distribution, it must be made clear to others what the license terms of this work are

The Konstanz Natural Video Database (KoNViD-1k)

Subjective video quality assessment (VQA) strongly depends on semantics, context, and the types of visual distortions. Currently, all existing VQA databases include only a small number of video sequences with artificial distortions. The development and evaluation of objective quality assessment methods would benefit from having larger datasets of real-world video sequences with corresponding subjective mean opinion scores (MOS), in particular for deep learning purposes. In addition, the training and validation of any VQA method intended to be ‘general purpose’ requires a large dataset of video sequences that are representative of the whole spectrum of available video content and all types of distortions. We report our work on KoNViD-1k, a subjectively annotated VQA database consisting of 1,200 publicdomain video sequences, fairly sampled from a large public video dataset, YFCC100m. We present the challenges and choices we have made in creating such a database aimed at ‘in the wild’ authentic distortions, depicting a wide variety of content